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Abstract 

We study the asymptotic behavior of a Markov chain on 1? that corresponds to the 
two-dimensional marginals of a reinforcement process on Z^. Three distinct asymp- 
totic regimes are identified, depending on the scaling of the reinforcement parameter 
A with respect to the number of steps performed by the chain. 
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1 Introduction 

We study the Markov chain (S'A(n'))n>o = (n)^ S^"^ (ri)\ on 1? defined by the 

V / n>0 

initial condition ^S'^^^(O), S'^^(O)^ = (0, 0) and the following transition kernel Ki^-, •] 
on 1?: 

f XA[(x,2/),(x±l,y±l)]-l/4fora;^y, 

i^A [(a;, x), (x + 1, a; + 1)] = \{x, x), (x~\,x-\)\ = % 
Ka [{x, x),{x + 1,x- 1)] = Ka [{x, x), {x + 1,x-1)] = ^, 

where 

2 + 2A 



2 + A ' 

and where A is a fixed non-negative parameter. 

The Markov chain (5A(n-))„>o defines a sticky random walk on Z^, in the sense 
that, when s''^\n) = S'^^(n), the two trajectories are more likely to stick together for 
the next step than to go apart from each other. Clearly from the definition above, the 
larger A, the stronger the stickiness of the walk. In fact, (S'A(n))„>o appears as the 
two-dimensional marginals of a more complex sticky Markov chain on Z^, as described 
in A similar model, where Z is replaced by (discretized versions of) the circle R/Z 
has been introduced in 0]. From 0, the behavior of S'a(?^) for large n and fixed 
A is degenerate, in the sense that n~^/^S'A(?^) converges in distribution to a couple 
of independent standard normal random variables, as would a couple of independent 
(normalized by n~^/^) random walks on Z do. The stickiness of the walk appears only 
in the corrections to this first-order behavior. In 0, the R/Z-version of the model is 
studied under regimes where n and A go to infinity simultaneously, with A ~ an^/^, 
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and the walk is shown to converge in distribution, after appropriate rescaling, to a 
non-trivial limiting process, formerly introduced in 0|, and known as the sticky flow 
on the circle. In the present paper, a similar scaHng for the two-dimensional marginals 
of the model on Z is investigated. In our opinion, the main interest of the present work 
is the expHcit formula obtained for the Fourier transform of the Hmiting distribution 
of the walk, since, to our knowledge, it is not possible to derive directly such explicit 
results from the construction of the sticky flow given in P] . 
Here is our main result. 

Theorem 1 Assume that the sequence (A„)„>o goes to infinity as n goes to infinity. 
The following holds: 

• if An — o(rt^/^), then 

• if An ^ an^/^, then 

where 5^,2 (1) is the probability distribution on whose Fourier transform 
<^a,2(l)(s,t) - / e''-'+'*--dS^,2{l){xi,X2) 



is given by the following formula 



'/'Q,2(l)(s,i) = cxp - 



1 + e 



1 -ts exp — - — X £a,s+t{x)dx 



where ta.s+t is defined in Section\^ below, 
• i/ A„ > n^/^, then 

where the random variable Z has the Af{0, 1) distribution. 

In the An = o(n^/^) regime, we conclude that the stickiness of the walk is not 
strong enough to yield a macroscopic effect on the limiting distribution, since, to the 
first order, the walk behaves as a couple of independent random walks on Z. In the 
A„ 3> n^/^ regime, the stickiness is so strong that, to the first order, the walk behaves 
as a single random walk on Z. The most interesting regime is the A„ ~ an^/^ regime, 
where the stickiness yields a non-trivial effect on the limiting distribution. Indeed, in 
this regime, the distribution of n'^^"^ SA,^{n) converges to a non-trivial limiting object, 
that we identify in as the distribution of the two-dimensional marginals of the sticky 
fiow on E at time 1 (yet to be constructed). 

The following corollary describes the asymptotic behavior of the covariance of 
S'^^^(n) and S'^^^in). It stems readily from Theorem above and the (easy) computa- 
tion of the partial derivative of the Fourier transform of 5q^2(1) at {t, s) — (0,0). 



Corollary 1 Assume that A„ ^ an^^"^ , then 



lim n 

I — ^ + oo 



Sllin)s'll{n)^ = J exp \^-^s ] x erfc ( ^y^]ds 
(the definition o/erfc is recalled in Section\^ below). 
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The structure of the paper is as follows. In Section |2l we define the function £a,w 
appearing in the expression of the Fourier transform of 5^,2(1)- 

In Section we derive explicit expressions for generating functions related to the 
walk. In Section 31 an asymptotic analysis of these expressions is performed. In 
Section Isl we use the results of the preceding sections to prove Theorem above. 
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2 Definition of i, 



a,w 



First, recall that, for all x e K, 

2 r 2 

erfc(a;) = 1 ^ / exp(-y 

V"^ Jo 

and that this function extends to an entire function on C. 
Now, for w e R and a > 0, such that — ^ 0, set 



with the convention that when a^^ ~ < 0, 7 is the square root with positive 

imaginary part, and 

bl = -2a"^ + 27, 62 = -2a"^ - 27. 
Define, for all a; > 0, the following function 



y exp r^x^j erfc f-y \/^] - y exp ^^x^j erfc f-y 



When a ^ — = 0, we set 



£a.w{x) = iexp (--^x 



4^^ + — + 2 exp — erfc 



This last expression can be obtained as the limit of Q when (a,w) converges to a 
limit (a*, w,) such that — wJ/4 = 0. 

3 Generating function computations 

For all J > 0, define 

and the corresponding generating functions, for z € [0, 1[: 

+00 

HA{j,t,z) = ^/iA(j,i,n)^", 

the above series being well defined since |/ia(j, < 1 by definition. 
Proposition 2 For a// i G M and z e [0, 1[, the following identities hold. 



1 



HA{0,t,z) 



uzcos(t) 
= 1 ^-(2-^.) 



1 - 



cos(/;)z 



— 1 / 1 — cos(<)z — 



HO 



ilA(l,t,^) = i?A(0,t,z) ( ^-UCOs{t)j 



anrf, /or all j > 2, 



HAij,t,z)^HAil,t,z) \ ^ ~ coa{t) ~ J ^ cos{t) 
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Proof of Proposition [2j 

A one-step analysis of the Markov chain (5'A("-))n>o yields 



P 



(S^^ (n + 1) = a, Sf (n + 1) = a) = (s'^^ (n) = a - 1, (n) = a - l) + 

(S^l\n) = a + 1, = a + l) + ip = a - 1, ^^'^(n) = a + l) + 

ip(5i^)(n) = a+l,5i')H=a-l), 

whence, taking Fourier transforms on both sides, and using the fact that, for obvious 
symmetry reasons, (S'^''(n), S'^''(n)) and (S*^-* (n), S*^' (n)) have the same distribution, 

cosfi) 1 
/iA(0,i,n+ 1) = w^^/iA(0,t,n) + -/iA(l,i,n). 

Similarly, 

P(5i^)(n + l) = a-l,5f (n) = a+l) = (^^^ P (^^(n) = a, 5^ (n) = a) + 
ip (S^^ {n)=a- 2, ^i') (n) = a + 2) + -P is'^^ (n) = a, S^^^ {n) = a + 2 



whence 



1 
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/2 — , 1, , , cos(i) , 
/iA(l,t,n+l) = ( ) /iA(0,t,n) + -/iA(2,i,n) + ^^;iA(l,t,n). 

Finally, for all j > 2: 

P (^'^ {n+l)^a~j,S^l\n+l)^a + j) ^ ip (s^^ (n) = a - j - 1, {n) = a + j + l) 
+ ip =a-j + l,5i')(n) = a+j-l) +ip (^^^ (n) = a - j - 1, (n) = a + j - l) 

+ip (^i^' (n) = a - J + 1, = a + J + 1) , 

whence 

hA{j,t,n + 1) = ^/iA(j - + ^^A(j + + ^^^Y^hA{j,t,n). 

Taking generating functions on both sides of the above identities, we obtain that 
i?A(0,t, z) — 1 cos(i) ,^ X 1 ,T 

^ ^ =7i^^i/A(0,t,z) + -ffA(l,i,z), 

that 

^ ^ = ——HA{Q,t,z) + -HA{2,t,z) + ^^HA{l,t,z), 
z 4 4 2 

and, for all j >2, that 

' = ^Ha{j - 1, t, z) + -i/A(j + 1, i, z) + ^^^^aO', t, z). 

For fixed z, the sequence {HA{j,t, z))j>i satisfies an order-two Hnear induction 
equation with constant coefficients, whose characteristic equation reads 

+ f^2cos(0 X + 1 = 0. 



For < z < 1, the characteristic equation has two distinct real zeros: 



qi{z) = - - cos(t) + y [ ~ ^ cos(t) ) - 1 



and 



q2{z) ~-~ cos(i) ^ \ (~ ~ cos(i) ) — 1. 



As a consequence, for all < z < 1, there exist a{z),P{z) e M such that, for every 
J> 1, 

HaU, t, z) = a{z)q^{zy-^ + (3{z)q2{zy'\ (1) 

Observe that < 92(2) < 1 < qi{z), and that, for fixed z £ [0, 1[, \HA{j,t, z)\ is 
bounded above by (1 — z)^^ , since \hA{j,t,n)\ < 1 for all n,j,t. As a consequence, 
one must have a{z) = 0, since otherwise, from Identity Q above, Hj{z) would go to 
infinity as j goes to infinity. Writing 



and 

we deduce that 
whence 



HA{l,t,z)^a{z)+/3{z) 

Ha{2, t, z) = a{z)qi{z) + f}{z)q2{z), 
f3{z) = HA{l,t,z), 



HA{j,t,z)^HA{l,t,z)q2{zy~\ 

for all j > 1. Turning back to Ha{0, t, z) we can express Ha{2, t, z) as a function of 
HA{i,t,z) in the preceding equations, whence a 2x2 linear system: 

HA(0,t,z)(z) - 1 cos(i) „ X 1 . 

^ ' ^ u^^HA{0,t,z) + -HA(l,t, z), 

HA(^,t,z) 2 — u , , 1 ,,,,,, , cos(i) , 

^ = -^HA{0,t,z) + -q2{z)HA{l,t,z) + ^^HA{l,t,z). 

We deduce the expressions of Ha{0, t, z) and Ha{1, t, z) stated in the Lemma. 

□ 

Introduce the Fourier transform fA{s,t,n) defined by 

fA{s,t,n) — E exp {isS^^ {n) + itS^^\n) 

We now show that /a(s, t, n) can be expressed in terms of the Fourier transforms 
/iA(0,s + i, •). 

Proposition 3 For all s,t,n,A, the following identity holds: 
/a(s, t, n) = (cos(t) cos(s))" + 

n-l 

■(C0s(t + s) — COs(t) C0s(s))j ^(cos(i) COs(s))'^/ia(0, i + S, 71 — fe — 1). 

fc=0 

Proof of Proposition 121 

A one-step analysis of the Markov chain [SA{n))n>o yields 



fA{s,t,n + \)=E [cxp {isS^^\n + 1) + itS^l\n + 1)) 



^ cos(t + s) + (1 ^ ^) cos{t) cos(s] 



E 



eyi]i[isS^l\n)+itS'l'{n)]l 



^{si^'(n)=Si='(n)}_ 



+ COs(t) C0s(s)i? 



exp 



(isS^^\n) + itSf{n)) l|s<i)(„)^5(.)(„)} 
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Observe that, by definition, 



hA{0,s + t,n) 
Using tiie decomposition 



exp 



l{sW(„)#si=)(n)} - 1 - l{si^>(„)=si^)H}' 

Identity ^ above rewrites 

r u 1 
/a(s, t,n + l) = — (cos(t + s) — cos(i) cos(s)) /ia(0, s + t, n) + cos{t) cos(s)/a(s, t, n). 



Iterating n times the above identity, we obtain the result of the Proposition. 



□ 



4 Asymptotic analysis of generating functions 

In this section, we use the exact formulae from the preceding section to prove the 
following proposition: 

Proposition 4 For all w (iR and 9 > 0, the following holds: 
• if An — o(n^/^), then 

lim n-i/^A-iy/i^ {0,wn-^^^k)exp(— 

k=0 ^ 



Jo 2 V 4 y 



if An ~ an^/^, th 



en 



lim n^^y^/iA (0, wn"^/^, fc) exp ( — ) — / exp(6'x)^(i m(a;)(ia;, 
k=a \ / -JO 



if An > n^/^, i/ien 



lim n ^'S^ Ha (0,wn ^^^,/c)exp[ — ) = [ exp{9x)exp\ x] dx. 

"^+°° \n J Jo V2y 



Proof of Proposition 21 

Define the following family of complex measures on K+ : 



+ CXD 



k=0 

The Laplace transform of Ma„(u',7i) is defined, for all A > 0, by 



C[MA„{w,n)] (A) 



e"^^dAfA„(w,n)(a;), 



so that: 



/:[MA„(w,n)] (A) ^u-^Ha^ (o,wn-^/^,cxp{-Xn-^)'^ 
Moreover, we have 



^ /lA (0,wn ^/^,fc)exp[ — ) = / exp 



{9x)dMA„{w,n) 



(2) 



6 



The A„ ~ an^/^ regime 

An asymptotic analysis of the explicit expression of Proposition [21 proves that 
lim C[MA„iw,n)] (A) = ^ 



We identify the above expression as the Laplace transform at A of the function 
^a,w{-), SO we deduce the result of the proposition from standard results on Laplace 
transforms (see e.g. chap. 13) and from Identity Q above. 

The A„ > regime 

It is easily checked from the expHcit expression of Proposition |2l that 

lim £[MA„(w,n)](A) ^ 2 /o ^ x ■ 

We identify the above expression as the Laplace transform at A of the function 
exp (^—^x^ , and the same standard arguments on Laplace transforms as above apply. 

The An = o{n^^'^) regime 
Again, an asymptotic analysis yields 



hm C 

n — ^+00 



n-i/2A-iMA„(u;,n)l (A) = 



whence the result of the proposition follows, identifying this last expression as the 
Laplace transform at A of the function 

1 



^exp^-x 



□ 



5 Proof of Theorem [T] 

The ~ an^/^ regime 

We start from the identity given in Proposition above: 



/A(s,i,n) = (cos(t)cos(s))" + 

^(cos(i + s) - cos(i) cos(s))l ^(cos(i) cos(s))''ft,A(0, t + s, n - fc - 1) 



For all < fc < n, 

(cos(tn~-^/^) cos(sn"^/^))'' = exp 

On the other hand. 



k=0 



{n — k) 



+ 



o2 1 



2n 



1 + 



7,3/2 



— (cos(in-i/2 + _ cos(in-i/2) cosisn^'/^)) = + o(n-3/2), 

2 n 



where m„ = ^q^f • 
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As a consequence, Equation (EJ above entails that 



/a„ (sn^i/^ tn-^/^, n) = exp ^- 



n 



2 

X exp f J ^ /iA„(0, {t + s)n^^/^, n - - 1) cxp 



St ( e + s^-^ — 



fc=0 



^2 _,_ ^21 



using the bound |ft.A| < 1 to handle the error terms. 

Applying Proposition El above with w = {s + t) and 6 = ^* , we see that 



lim /A„(sn-i/^in^^/^n) 



exp 



s2 + t2 



1-ts I exp I ^ ^ ^ X ) £a,s+t{x)dx 







Observe that the sequence of random variables {n "'^^^5a„ ("•))n>o is tight in distribu- 
tion, since, for every A > 0, Sl\n) and s''^\n) are both distributed as the position 
at time n of a simple symmetric random walk on Z. By the standard result on the 
convergence of Fourier transforms (see e.g. |^ chap. 3) and Identity above, we de- 
duce the result of the theorem in the A„ ~ an^^^ regime, that is, we deduce that 
n~^/25'A„(n) converges to a Hmiting distribution 5q,2(1) on M^, and that the Fourier 
transform of 5q,2(1) is indeed given by the formula of the theorem. 

The A„ > regime 

The proof is similar, the only difference being that the limiting Fourier transform we 
obtain from Proposition HI is not the same: 



lim /A„(sn ^/^,t7i ^/2,n)=exp 



The An = o{n^^'^) regime 

The proof is similar. From Proposition 21 



lim n ^ y^(cos(t) cos(s))'°/ia(0, t + s, 71 — /c) = 0, 

n — > + oo ^- — ^ 

SO the only term yielding a non-negligible contribution in Identity |2l above is 

(cos(in-i/")cos(sn-i/2)^"^ 



whence 



lim /A„(sn"^/^,tn~^/2,n) = exp — 

1— »+oo Y 2 y 



n — >+oo 

This ends the proof of the theorem. □ 
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